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Extended time-delay auto-synchronization (ETDAS) is a 
promising technique for stabilizing unstable periodic orbits in 
low-dimensional dynamical systems. The technique involves 
continuous feedback of signals delayed by multiples of the 
orbit's period in a manner that is especially well-suited for fast 
systems and optical implementation. We show how to analyze 
the stability of a given implementation of ETDAS without 
explicit integration of time-delay equations. To illustrate the 
method and point out some nontrivial features of ETDAS, 
we obtain the domain of control for a period-one orbit of the 
driven, damped pendulum. 



I. INTRODUCTION 

The prospect of "controlling chaos" has generated 
great interest among physicists over the past several 
years. As first pointed out by Ott, Grebogi, and Yorke, 
101 the existence of many periodic orbits embedded in 
strange attractors raises the possibility of using very 
small control signals to obtain various types of regular 
behavior from intrinsically chaotic systems. This fact 
has implications both for engineering nonlinear systems 
in which chaotic fluctuations occur but are undesirable 
and for the understanding of biological systems in which 
underlying nonlinear dynamical systems are regulated in 
ways that are at present poorly understood. 

The initial problem that must be faced in developing 
a control mechanism requiring only small externally im- 
posed perturbations to the system is to design a feedback 
scheme that allows an unstable periodic orbit (UPO) 
to be stabilized. Recently several techniques have been 
introduced for accomplishing this using feedback sig- 
nals that actually vanish (in the absence of noise) when 
the system is on the desired orbit. |^ One such tech- 
nique, sometimes called "time-delayed autosynchroniza- 
tion" (TDAS) involves a control signal formed from 
the difference between the current state of the system 
and the state of the system delayed by one period of the 
UPO. One of us (JESS) and coworkers have showed how 
to efficiently reuse information generated further in the 
past 1^ , using a technique called "extended time-delayed 
autosynchronization" (ETDAS). In the extended scheme, 
discussed in detail below, the control signal consists of a 
particular linear combination of signals from the system 
delayed by integer multiples of the UPO's period. TDAS 
is a special, limiting case of ETDAS. 

ETDAS has several features of practical interest. 
First, the use of a time-delay in the feedback loop elimi- 
nates the need for explicitly determining any information 
about the underlying dynamics other than the period of 



the desired orbit. Second, it can be implemented using a 
continuous feedback loop and hence can be applied to sta- 
bilize oscillations that are too fast to be handled by stan- 
dard techniques based on measurements of the system on 
a surface of section. Finally, ETDAS provides a natural 
choice for controlling chaos using all-optical methods, as 
the feedback signal corresponds precisely to the reflected 
signal from a Fabry-Perot interferometer with properly 
adjusted cavity length. 

This paper concerns the stability analysis of ETDAS 
in continuous systems for which the dynamical equations 
are known. We note that versions of ETDAS that ap- 
ply to discrete maps can be treated analytically and it 
is known that ETDAS can stabilize orbits that are un- 
controllable using TDAS. 10,01 For continuous systems, 
both numerical results |0,§[ and experiments 10 
have shown that in order for ETDAS to be successful the 
feedback gain must lie within a finite, and often narrow, 
range. As the UPO is modified by changes in a bifur- 
cation parameter this range of successful feedback gain 
will in general shift. In the space of the feedback gain 
and a bifurcation parameter, the area for which ETDAS 
can be successfully applied is known as the domain of 
control. Here we show how the domain of control can 
be obtained, and as an example, we find such a domain 
for the nonlinear pendulum. Though the domain of con- 
trol could also be mapped using direct integration of the 
time-delay differential equations governing the controlled 
system, such a procedure may encounter difficulties asso- 
ciated with the accuracy of the integrator over long times 
and the choice of initial conditions. Our technique avoids 
both of these difficulties, requiring only the integration 
of equations with no time delay over one period of the 
UPO. 

The results from the pendulum demonstrate the effec- 
tiveness of ETDAS in controlling highly unstable orbits 
that are impossible to stabilize with TDAS. The analysis 
also shows that the domain of control is surprisingly com- 
plex and depends strongly on the particular choices of 
the accessible control parameter and the measured signal 
used to generate the feedback. The domains of control 
have several features that clearly distinguish the applica- 
tion of continuous control of a period-one orbit from the 
control of a fixed point of a discrete map. 

Two items that may be important in experimental im- 
plementations of ETDAS but are not treated here are 
the effects of noise and the unavoidable small time lag 
between the measurement of the system and the appli- 
cation of feedback. Preliminary numerical investigations 
and experiments on fast diode resonators jl^ indicate 
that low noise levels and small time lags shift the bound- 
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aries of the domain of control only by small amounts. 
The results we obtain for the idealized situation do in- 
deed give a useful guide to the phenomenology of real 
systems. 



II. STABILITY ANALYSIS 

A general form for an iV-dimensional system governed 
by ordinary differential equations and controlled via vari- 
ations in an accessible parameter k is 



x(t) =f (x(<),i;K), 



(1) 



where x(t) and f are iV-dimensional vectors and e{t) is 
a small control signal. In ETDAS, the control signal is 
given by 



(2) 



where ^ is some measured component of x, r is the period 
of the desired UPO, and i? G [0, 1) is a real parameter. 
The case R — corresponds to TDAS. Note that when 
control is successful, the system is synchronized with its 
own past behavior, so ^(i — fcr) = ^(t) for all k and e(t) 
vanishes. Thus to analyze the stability of the controlled 
system with respect to small perturbations, it is suffi- 
cient to consider a linearized form of Eqn. (|l|) in which 
both e{t) and the deviations from the UPO are consid- 
ered small. Letting Xo{t) be the UPO and y(t) be the 
deviation from this orbit, y(i) = x(i) — xo(i), we have 



y(t) = J(<) • y(t) 



(3) 



where J (xo(t)) = ^ |xo(tLKo ^^'^ Jacobian of the un- 
controlled system. Eqn. (g), with e given by Eqn. (||), 
can also be written as 



y{t) - J{t) ■ y{t) 
+ 7M(i) 



y(t)-(l-i?)£i?^-V(t-fcT) 



k=l 



, (4) 



where M(xo(t)) = (|| U„{t),K„) ® n, is an iV x TV dyadic 
which contains all information about how the control is 
applied to the system; n is a constant unit vector that 
determines the component of x that enters the control 
signal via ^ = n • x, and ^ describes the effect on 
the dynamics of small changes of the control parameter 
K. Eqn. applies to both periodically driven and au- 
tonomous systems. For periodically driven systems, the 
period r is equal to the period of the drive (or an integer 
multiple of it); for autonomous systems r is not known 
a priori, but it can be repeatedly adjusted until control 
is achieved. (One scheme for making the adjustment is 



discussed by Kittel et al. Our goal is to investigate 
the stability of the trivial y = solution of Eqn. (Q), 
which corresponds to the system remaining on the UPO. 

Eqn. (IJ) is a special case of a form that has been 
treated in the mathematics literature. Jl^ It can be writ- 
ten as 



y(i) = ^A„(t)-y(^-: 



(5) 



where y{t) is an A^-dimensional vector and each A„(i) is 
an N X N matrix with elements that are periodic in time 
with period r. Specifically, we have 

A J(i)+7M(t) forn-0 

~ \ -7(1 - i?)i?"-iM(t) for n = 1, 2, 3, .... 

Notice that J and M (and consequently A„) are periodic 
with period r by virtue of the fact that they are evaluated 
along the UPO. 

The general approach to the linear stability of integer 
time-delay differential equations with periodically vary- 
ing coefficients has been discussed by Hale and Verduyn 
Lunel (The one-dimensional case has also been ad- 
dressed by Ortega . ) We briefly outline here a deriva- 
tion of their central result, which then will be used as the 
basis for an efficient numerical technique for mapping the 
domain of stability in the appropriate parameter space. 

By virtue of the linearity of Eqn. (|^), a general solution 
can be composed from a sum of periodic modes with 
exponential envelopes: 



yk{t) = Pk{t)exp{Xkt/T), 



(7) 



where Pkit + r) = Pk{t) is an A^-dimensional vector and 
A is a complex number. For one such mode, one obtains 
from Eqn. (|^) (dropping the subscript k) 



A. 



(8) 



n=0 

Equivalently we can write 

p(t)=e-^*/^U(t)-p(0), (9) 
where the matrix XJ{t) is the solution of the equation 



U(i) = J2 e""^A„(i) • U(t) 



(10) 



with U(0) = 1. Defining the Floquet multiplier n = 
a formal solution for U(t) can be written as 



U(t) = T 



(11) 



where T[- ■ ■] indicates the time-ordered product. The 
time-ordered exponential is simply a compact notation 
[p^ used to emphasize the way in which U(t) depends on 
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fj,. In general, U(r) must be obtained by direct numerical 
integration of Eqn. (|o|). 

In order for p(t) to be periodic, Eqn. ^ implies that 
p(0) must satisfy the equation 



iU(r)-U(0)) •p(0)-0. 



(12) 



which in turn requires the vanishing of the determinant of 
(^Ij,~^XJ{t) — U(0)) . Substituting for the U's one obtains 
a modified eigenvalue equation for /i: 



- 1 



= 0. 



(13) 



Eqn. (^ shows that the trivial solution of Eqn. (^) is 
asymptotically stable if and only if all /i which satisfy 
Eqn. ( |l3| ) also satisfy |^| < 1. This is the central result 
advertised above. 

Inserting Eqn. (||) into Eqn. (|l^) and performing the 
geometric sum over coefficients of M, we have 



-M(t) 



0, (14) 



the defining relation for Floquet multipliers of systems 
under ETDAS control. The system is linearly (or locally 
asymptotically) stable if and only if |At~"'^| > 1 for all /i 
satisfying Eqn. (0). |l|l. For i? < 1, the determinant 
on the left hand side of Eqn. (^^ , which will be denoted 
(7(/i~^), has no poles inside the unit circle. Hence, by a 
well-known theorem in complex analysis, the number of 
roots of g{ii~^) with < 1 is equal to the number of 

times the path traced by g(fi~^) winds around the origin 
as fj,^^ is varied one full time around the unit circle. |lq ] 
The condition for linear stability of the controlled system 
is that this winding number, which will be denoted A/", 
vanishes. 

For generic J{t) and M(i), the time-ordered integral 
discussed above cannot be obtained in closed form, and 
so must be computed numerically by explicitly integrat- 
ing Eqn. (p^. p^ ] Note, however, that this is an ordi- 
nary integration which does not involve any time-delayed 
quantities. Thus we have avoided the integration of a 
time-delay differential equation, for which the issue of 
how to choose initial conditions can be rather delicate. 



III. NUMERICAL PROCEDURES 

In a typical situation, the system parameters that can 
be externally adjusted are largely dictated by physical 
principles and practical considerations. The problem is 
therefore to determine whether control can be achieved 
for a given designation of the control parameter k. In 
general, we may expect the success of ETDAS in con- 
trolling highly unstable orbits to depend upon the choice 
of which system variable is used to construct the feed- 
back signal; i.e., the choice of n. We wish to determine 



the domain of values of n, 7, and R for which ETDAS 
is successful for a given k. If the dynamical equations 
governing the system are known, the results can provide 
direct guidance in selecting appropriate parameters for 
operating the controlled system. The exercise of com- 
puting the domain of control for a simple model is also 
useful in that it reveals qualitative features that should 
be kept in mind when trying to find a stable regime in a 
system for which the equations are not known. 

In general, the function f in Eqn. (|^) depends on a "bi- 
furcation parameter" , which we denote r. As r is varied, 
the properties of a given UFO change, so the stability 
must be considered separately for different r. We choose 
to map the domains of control in the plane of the bifur- 
cation parameter, r, and the feedback gain, 7, for several 
discrete choices of n and R. 

Calculation of the domain of control for a system given 
by Eqn. (|^) and particular choices of k, fi, and R involves 
three distinct numerical tasks: 

1. the determination of the desired periodic orbits of 
the uncontrolled system; 

2. the calculation of g{fi^^) for a given fi on the unit 
circle and given values of r and 7; and 

3. the evaluation of the winding number. A/", which 
determines the number of unstable modes. 

The first is easily accomplished using a standard New- 
ton's method. Using the period of the resulting solu- 
tion and a point on the orbit, the second task requires 
straightforward simultaneous integration of the uncon- 
trolled dynamical equations and the set of first-order 
ordinary differential equations (Eqn. (|l^)) that deter- 
mine U(r). In the cases we have studied, a fifth order 
adaptive step-size Runga-Kutta method has proven sat- 
isfactory. Finally, Af can be determined by evaluating g 
for a sequence of sufficiently closely spaced /x's around 
the unit circle and considering the sequence of values of 
a.rgg{^^^). The necessary number of points in the se- 
quence depends upon the proximity of roots of g to the 
unit circle. 

With these tools in hand, the boundary of the domain 
of control may be located by the following method. First, 
a single point on the boundary must be determined. If 
the orbit of the uncontrolled system becomes unstable 
when r — Tc, a point on the boundary of the domain of 
control can always be found at (r, 7) = (rc,0) since for 
7 = the controlled system is identical to the system 
without feedback control. An entire boundary may then 
be traced by changing r in small increments, each time 
searching over a small interval in 7 to locate the bound- 
ary. The boundary of the domain of control is identified 
as the point where the winding number jumps from zero 
to a positive integer, signalling the entry of a root into 
the unit circle. |0 

Additional work may be necessary in order to find all 
the islands of stability, since the domain of control may 
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not be simply connected. We have encountered this sit- 
uation only in the case where a given periodic orbit is 
unstable only over a finite interval in the parameter r 
with endpoints ri and r2. In this case, there are two 
separate regions of stability, each of which can be found 
starting from r = ri_2, 7 = 0. (See the example discussed 
below.) We have not been able to rigorously rule out the 
occurrence of more complicated situations in which a do- 
main has a hole in it or an island of stability exists that 
does not merge into an intrinsically stable regime. We 
have tested for this by scanning through large intervals 
of 7 for selected values of r in two different systems, the 
pendulum discussed below and a diode-resonator circuit 
that will be the subject of a future publication , and 
have yet to observe such behavior. 

As a check of the above analysis and numerical proce- 
dure, selected sections of the stability domains presented 
below were checked with explicit integration of the time- 
delayed differential equations given by Eqn. (|^) . Using a 
fourth order Adams-Bashforth-Moulton algorithm modi- 
fied for time-delayed equations, we found complete agree- 
ment between the two methods to the expected degree of 
accuracy. We emphasize, however, that our procedure is 
more reliable and significantly easier to automate. 

IV. AN EXAMPLE: THE NONLINEAR 
PENDULUM 

To demonstrate the utility of the stability analysis de- 
scribed above and begin to investigate the structure of 
domains of control, we calculate stability domains for 
the damped driven nonlinear pendulum: 

Xi = X2 (15) 
X2 — —1^X2 — sinxi + Fcos{Lut). (16) 

Here xi is the angle of the pendulum and X2 is its angular 
velocity; v, F, and uj describe the damping, drive ampli- 
tude and drive frequency, respectively. We fix ly = 1/2 
and ll! = 27r/10, and vary F as the bifurcation parameter. 

We choose to study a family of period-one orbits which 
are unstable between F ~ 0.987, and F ~ 2.046. These 
orbits and their largest Floquet multipliers are shown in 
Fig. 1. Note that some of these orbits are highly un- 
stable, having Floquet multipliers as high as 30. The 
explicit demonstration (below) that periodic orbits with 
multipliers this large can be stabilized using continuous 
time-delay techniques is a new result, though a plausi- 
bility argument has been given based on the behavior of 
discrete maps. |^ 

ETDAS requires that we measure some accessible 
quantities in the system and feed back the control signal 
through small modifications of an accessible parameter. 
We assume that both the position and velocity of the 
pendulum are measurable, and that small changes can 
be made to the amplitude of the drive, F ^ F + e{t). 
(Note that F is being used here in a dual role, both as 



the bifurcation parameter, r, and the accessible control 
parameter, k.) The control signal is generated from a lin- 
ear combination of deviations in position and velocity. In 
the notation of Eqn. (^, we have n = (sin 0, cos </>), where 
— 7r/2 <(/)<7r/2isa parameter that can be chosen to op- 
timize the domain of control. The range —tt/2 < (p < tt/2 
is sufficient to describe the entire space of possibilities 
since the case -|- tt is equivalent to with the sign of 
the feedback gain reversed. Note that = corresponds 
to measuring velocity only, and (p = tt/2 corresponds to 
measuring position only. The control matrix M is given 
by 

M{t) = F cos{cut) ( . ° , V (17) 
^ ' V smc/) cos(/) J ^ ' 

Our numerical implementation of the program outlined 
above was straightforward. The most significant source 
of potential errors is the possibility that a root of f;(/i~^) 
crosses into the unit circle but remains extremely close to 
the boundary and is not picked up in the winding number 
calculation. This problem can be solved to any desired 
accuracy by choosing sufficiently many points around the 
unit circle in evaluating TV (or by using adaptive step-size 
methods). For the present case, 500 equally spaced points 
were used. This large number was necessary, however, 
only to obtain accurate results in regimes with very nar- 
row features. In general, the necessary spacing between 
points is determined by the rate at which the first root 
enters the unit circle as 7 is varied across the stability 
boundary. 

The dependence on i? of the domain of control is shown 
in Fig. 2 for = — 7r/8 which is representative of all values 
of (p that we investigated. A key point that is evident 
here is that large values of i? are necessary in order to 
control the highly unstable periodic orbits. In addition, 
the domain of control strongly depends on the choice of 
(/i, as might be expected by analogy with the situation 
for proportional feedback control of a stationary fixed 
point. Fig. 3 shows the domain of control for R = 0.95 
and several choices of (j). The domain extends across 
the entire unstable region only for within a relatively 
narrow range near = 0, indicating the relative merit of 
measuring the velocity of the pendulum for our example 
in which the control signal is applied to the amplitude of 
the drive. Even for R close to 1, it is not always possible 
to control highly unstable orbits for arbitrary 0. 

The results depicted in Fig. 3 illustrate the complexity 
of the domain of control. The sharp features and the 
existence of reentrant behavior for varying 7 indicate that 
intuition about the qualitative shapes of these domains 
may be highly misleading. An interesting example of the 
counterintuitive phenomena that can occur can be seen 
in the case = tt/S. As shown in Fig. 4, there is a region 
for which both 7 and —7 successfully stabilize an UPO. 
In this region, one has an orbit that is unstable in the 
absence feedback. Naively, one would expect that if a 
given form of linear feedback resulted in stabilization of 
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the orbit, then reversing the sign of the feedback gain 
would make the orbit even more highly unstable. In the 
present case, however, the variation of J around the orbit 
allows the inverted feedback gain to be equally effective in 
stabilizing the orbit. This can never occur for the case of 
linear control of a stationary fixed point in a continuous 
system or a discrete map. 

The most important point here is that the experimen- 
tal determination of the ETDAS domain of control for 
a given system should be guided as much as possible by 
calculations on model equations. A coarse scan of pa- 
rameter space guided by "intuitively reasonable" ideas 
concerning the possible structure of these domains may 
well miss regimes of practical interest. 

V. CONCLUSIONS 

The primary purpose of this paper is to demonstrate 
the proper technique for analyzing the stability of sys- 
tems controlled using ETDAS. Generic systems do not 
permit a complete analytical solution, even for the linear 
stability problem. The logic of our approach does, how- 
ever, allow the development of a clean numerical tech- 
nique. In particular, it avoids the need for integrating 
delay-differential equations directly and thereby avoids 
the difficulties associated with guaranteeing that a cho- 
sen initial condition lies in the appropriate basin of at- 
traction. 

The analysis of an orbit of the nonlinear pendulum 
confirms the fact that ETDAS can work well in contin- 
uous systems and also clearly illustrates the complexity 
of this linear stability problem. We have also studied 
a set of equations describing a fast diode resonator and 
compared our results with experiments. Details will be 
published together with the experimental results. Here 
we note only that the effects of noise and a time lag in 
the feedback loop outside the recursively used delay line 
Iprf do alter the domains of control slightly. Inclusion of 
these effects and extensions of the technique to spatially 
extended systems will be addressed in future studies. 

We thank D. Gauthier, H. Greenside, J. Sethna, and 
D. Sukow for helpful conversations and D. Gauthier for 
a critical reading of the manuscript. This work was sup- 
ported by NSF Grant DMR-9412416. 
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Figure 2. The domain of control for 4> = — 7r/8 for i? = 0, 0.5, 0.95. Labels A, B, and C indicate 
the regions where the controlled system is stable for R = 0.95, 0.5, and 0, respectively. The 
inset is an enlargement of the lower right hand side. The arrows at the top (and the vertical 
line in the inset) indicate the value of the drive amplitude for which the uncontrolled orbit 
loses stability. 
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Figure 3. The domains of control for several values of the measured control signal and R = .95. 
(See text for definition of 4>.) The arrows at the top indicate the value of the drive amplitude 
for which the uncontrolled orbit loses stability. The horizontal scale is the same for each plot. 
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Figure 4. Domain of control for (f) = 7r/8 and R = 0.95. The two regions within the thick lines 
contain points for which the sign of the feedback gain can be inverted and the orbit will still 
be controlled. The arrow indicates the value of the drive amplitude for which the uncontrolled 
orbit loses stability. 
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